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APPARATUS FOR CONTROLLING THE POSITION OF A SCREEN 
POINTER WITH LOW SENSITIVITY TO PARTICLE 
CONTAMINATION 

Cross-Reference to Related Applications 

This application is related to U.S. Patent Application Serial No. 
, attorney docket no. 10040077-1, filed March 8, 2004, and 



entitled APPARATUS FOR CONTROLLING THE POSITION OF A SCREEN 
POINTER THAT DETECTS DEFECTIVE PIXELS; and U.S. Patent 

10 Application Serial No. , attorney docket no. 10040349-1, filed 

on the same date as the present application, and entitled CONTAMINANT- 
RESISTANT OPTICAL MOUSE AND CRADLE. 

The Field of the Invention 

15 This invention relates generally to devices for controlling a pointer on a 

display screen, and relates more particularly to an apparatus for controlling the 
position of a screen pointer with low sensitivity to particle contamination. 

Background of the Invention 

20 The use of a hand operated pointing device for use with a computer and 

its display has become almost universal. One form of the various types of 
pointing devices is the conventional (mechanical) mouse, used in conjunction 
with a cooperating mouse pad. Mechanical mice typically include a rubber- 
surfaced steel ball that rolls over the mouse pad as the mouse is moved. Interior 

25 to the mouse are rollers, or wheels, that contact the ball at its equator and convert 
its rotation into electrical signals representing orthogonal components of mouse 
motion. These electrical signals are coupled to a computer, where software 
responds to the signals to change by a AX and a AY the displayed position of a 
pointer (cursor) in accordance with movement of the mouse. 

30 In addition to mechanical types of pointing devices, such as a 

conventional mechanical mouse, optical pointing devices have also been 
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developed. In one form of an optical pointing device, rather than using a moving 
mechanical element like a ball, relative movement between an. imaging surface, 
such as a finger or a desktop, and an image sensor within the optical pointing 
device, is optically sensed and converted into movement information. 
5 Electronic image sensors, such as those typically used in optical pointing 

devices, are predominantly of two types: CCDs (Charge Coupled Devices) and 
CMOS - APS (Complimentary Metal Oxide Semiconductor - Active Pixel 
Sensors). Both types of sensors typically contain an array of photodetectors 
(e.g., pixels), arranged in a pattern. Each individual photodetector operates to 

10 output a signal with a magnitude that is proportional to the intensity of light 
incident on the site of the photodetector. These output signals can then be 
subsequently processed and manipulated to generate an image that includes a 
plurality of individual picture elements (pixels), wherein each pixel in the image 
corresponds with one of the photodetectors in the image sensor. 

15 Despite advances in the manufacturing process, digital image sensors 

often contain a few defective pixels as a result of noise or fabrication errors, such 
as impurity contamination. Defective pixels can also arise after the 
manufacturing process and during use by a customer. Defective pixels respond 
inappropriately to the incident light, and therefore produce inaccurate sensor 

20 values. Defective pixels are predominantly of three types: stuck high, stuck low, 
or abnormal sensitivity. A stuck high pixel has a very high or near to full scale 
output, while a stuck low pixel has a very low or near to zero output. An 
abnormal sensitivity pixel produces a sensor value different from neighboring 
pixels by more than a certain amount when exposed to the same light conditions. 

25 If the image sensor of an optical pointing device contains defective 

pixels, such as stuck high or stuck low pixels, the values from these pixels may 
never change, which biases the navigation computation and can cause errors. 
The values from abnormal sensitivity pixels may change, but such pixels do not 
perform as expected and can also cause errors. The bad pixels can be caused by 

30 one or more of the following: (1) defects in the silicon; (2) external 

contamination (e.g., particles such as dust or dirt, fibers, "flash," etc., landing on 
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the array); and (3) improper illumination (e.g., the illumination spot can be de- 
centered such that part of the array is too "dark"). "Flash" is mold compound 
that sticks out from a molded piece and that can come loose from the molded 
piece during production or during use by a customer, and cause particle 
5 contamination of the array. 

For optical pointing devices that use incoherent illumination, such as 
typical LED-based devices, dust and other particle contamination may remain 
out of focus and, therefore, have a negligible effect on performance. In contrast, 
optical pointing devices that use coherent illumination, such as light from a laser, 
10 are more sensitive to dust particles adhering to the illumination source or the 
focusing optics. Coherent illumination of dust particles and other particle 
contamination can produce visible fringe artifacts in the generated images, which 
adversely affects performance. It is difficult to completely eliminate particle 
contamination in optical pointing devices. 

15 

Summary of the Invention 

One form of the present invention provides an apparatus for controlling 
the position of a screen pointer. The apparatus includes an at least partially 
coherent light source for illuminating an imaging surface, thereby generating 

20 reflected images. The apparatus includes a navigation sensor for generating 
digital images based on the reflected images, performing a movement 
computation based on the digital images, generating movement data based on the 
movement computation that is indicative of relative motion between the imaging 
surface and the apparatus, wherein the movement computation has a low 

25 sensitivity to effects in the digital images caused by particle contamination. 

Brief Description of the Drawings 

Figure 1 is a block diagram illustrating major components of an optical 
pointing device according to one embodiment of the present invention. 
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Figure 2 is a flow diagram illustrating a method for generating movement 
data with the optical pointing device shown in Figure 1 using temporal 
differences according to one embodiment of the present invention. 

Figure 3 is a flow diagram illustrating a method for generating movement 
5 data with the optical pointing device shown in Figure 1 using cross-correlation 
of row sums and column sums according to one embodiment of the present 
invention. 

Figure 4 is a flow diagram illustrating a method for generating movement 
data with the optical pointing device shown in Figure 1 using false correlation 
10 peak detection according to one embodiment of the present invention. 

Figure 5 is a block diagram illustrating major components of an optical 
pointing device with a defective pixel detector according to one embodiment of 
the present invention. 

Figure 6 is a flow diagram illustrating a method for generating movement 
15 data with the optical pointing device shown in Figure 5 based on a set of active 
pixels according to one embodiment of the present invention. 

Figure 7 is a flow diagram illustrating a method for generating movement 
data with the optical pointing device shown in Figure 5 based on a sub-array of 
pixels according to one embodiment of the present invention. 

20 

Description of the Preferred Embodiments 

In the following detailed description of the preferred embodiments, 
reference is made to the accompanying drawings, which form a part hereof, and 
in which is shown by way of illustration specific embodiments in which the 

25 invention may be practiced. It is to be understood that other embodiments may 
be utilized and structural or logical changes may be made without departing 
from the scope of the present invention. The following detailed description, 
therefore, is not to be taken in a limiting sense, and the scope of the present 
invention is defined by the appended claims. 

30 As mentioned above in the Background of the Invention section, particle 

contamination can adversely affect the performance of optical pointing devices 
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that use coherent illumination. It is difficult to completely eliminate particle 
contamination in these optical pointing devices. Thus, one form of the present 
invention provides a compensation mechanism to cope with dust or other particle 
contamination being present. In one embodiment, compensation is included in 
5 the digital processing of images, which is performed by a navigation processor 
after images are acquired. In one form of the invention, the digital processing or 
computations performed by the navigation processor have a low sensitivity (i.e., 
high tolerance) to effects in the acquired digital images caused by particle 
contamination. An important aspect of the dust tolerant digital processing that is 
10 performed according to one embodiment of the invention is that dust, or other 
particle contamination, once it adheres to an imaging surface and is coherently 
illuminated, forms a fixed pattern in the captured images. Thus, one form of the 
invention provides a method for removing or suppressing fixed patterns in the 
digital images captured by an optical pointing device. 

15 

I. OPTICAL POINTING DEVICE 

Figure 1 is a block diagram illustrating major components of an optical 
pointing device 100 according to one embodiment of the present invention. 
Optical pointing device 100 includes optical navigation sensor integrated circuit 

20 (IC) 102, light source 118, and lens 120. Optical navigation sensor 102 includes 
digital input/output circuitry 106, navigation processor 108, analog to digital 
converter (ADC) 112, photodetector array (photo array) 1 14, and light source 
driver circuit 116. In one embodiment, optical pointing device 100 is an optical 
mouse for a desktop personal computer, workstation, portable computer, or other 

25 device. In another embodiment, optical pointing device 100 is configured as an 
optical fingerprint sensing pointing device, or other pointing device. 

In operation, according to one embodiment, light source 118 emits light 
122 onto navigation surface 124, which is a desktop or other suitable imaging 
surface, and reflected images are generated. In one embodiment, light source 

30 1 18 is a coherent light source or an at least partially coherent light source. In 
one embodiment, light source 118 is a laser. In one form of the invention, light 
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source 118 is a vertical cavity surface emitting laser (VCSEL) diode. In another 
form of the invention, light source 118 is an edge emitting laser diode. Light 
source 1 18 is controlled by driver circuit 116, which is controlled by navigation 
processor 108 via control line 110. In one embodiment, control line 110 is used 
5 by navigation processor 108 to cause driver circuit 1 16 to be powered on and off, 
and correspondingly cause light source 1 18 to be powered on and off. 

Reflected light from surface 124 is directed by lens 120 onto 
photodetector array 1 14. Each photodetector in photodetector array 1 14 
provides a signal that varies in magnitude based upon the intensity of light 

10 incident on the photodetector. The signals from photodetector array 1 14 are 

output to analog to digital converter 112, which converts the signals into digital 
values of a suitable resolution (e.g., eight bits). The digital values represent a 
digital image or digital representation of the portion of the desktop or other 
navigation surface under optical pointing device 100. The digital values 

15 generated by analog to digital converter 1 12 are output to navigation processor 
108. The digital values received by navigation processor 108 are stored as 
frames within memory 111. 

The overall size of photodetector array 1 14 is preferably large enough to 
receive an image having several features. Images of such spatial features 

20 produce translated patterns of pixel information as optical pointing device 100 
moves over navigation surface 124. The number of photodetectors in array 1 14 
and the frame rate at which their contents are captured and digitized cooperate to 
influence how fast optical pointing device 100 can be moved across a surface 
and still be tracked. Tracking is accomplished by navigation processor 108 by 

25 comparing a newly captured sample frame with a previously captured reference 
frame to ascertain the direction and amount of movement. 

In one embodiment, navigation processor 108 performs a cross- 
correlation of sequential frames to determine motion information. In one form 
of the invention, the entire content of one of the frames is shifted by navigation 

30 processor 108 by a distance of one pixel successively in each of the eight 

directions allowed by a one pixel offset trial shift (one over, one over and one 
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down, one down, one up, one up and one over, one over in the other direction, 
etc.). That adds up to eight trials. Also, since there might not have been any 
motion, a ninth trial "null shift" is also used. After each trial shift, those portions 
of the frames that overlap each other are subtracted by navigation processor 108 
5 on a pixel by pixel basis, and the resulting differences are preferably squared and 
then summed to form a measure of similarity (correlation) within that region of 
overlap. In another embodiment, larger trial shifts (e.g., two over and one down) 
may be used. The trial shift with the least difference (greatest correlation) can be 
taken as an indication of the motion between the two frames. That is, it provides 

10 raw movement information that may be scaled and or accumulated to provide 

movement information (AX and AY) of a convenient granularity and at a suitable 
rate of information exchange, which is output to a host device by digital 
input/output circuitry 106 on data and control lines 104. Optical pointing device 
100 is also configured to receive data and control signals from a host device via 

15 data and control lines 104. 

H. DEFECT TOLERANT DISPLACEMENT CALCULATIONS 

In one form of the invention, rather than performing a correlation of 
successive digital images to determine movement information as described 

20 above, navigation processor 108 is configured to perform movement 

computations or displacement calculations that have a low sensitivity to effects 
in the acquired digital images caused by particle contamination, such as dust. 
Particle contamination causes pixels in the digital images captured by device 100 
to have inappropriate pixel values. The pixels affected by the particle 

25 contamination are referred to herein as defective pixels. In addition to particle 
contamination, defective pixels can also be caused by other problems, such as 
silicon defects. A defective pixel is defined to include an aberrant or inoperative 
pixel, such as a pixel that exhibits only an "ON" or an "OFF' state, a pixel that 
produces less intensity or more intensity than desired, or a pixel with 

30 inconsistent or random operation. Regardless of the source of the defects, the 

defective pixels form a fixed pattern in the captured digital images. One form of 
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the present invention provides a method for generating movement data that has a 
low sensitivity to defective pixels in general, regardless of the cause of the 
defects. Defect tolerant displacement calculations that are performed by 
navigation processor 108 according to various embodiments of the present 
5 invention are described below with reference to Figures 2-4. 

Figure 2 is a flow diagram illustrating a method 200 for generating 
movement data with optical pointing device 100 using temporal differences 
according to one embodiment of the present invention. In step 202, a pair of 
temporally offset images is acquired by photo array 1 14. The acquired images 

10 are converted into digital images by analog to digital converter 112, and the 
digital images are output to navigation processor 108. In step 204, navigation 
processor 108 subtracts the two digital images (acquired in step 202) on a pixel- 
by-pixel basis, thereby generating a difference image, which is referred to as a 
reference difference image. In step 206, another pair of temporally offset images 

15 is acquired by photo array 1 14. The acquired images are converted into digital 
images by analog to digital converter 112, and the digital images are output to 
navigation processor 108. In step 208, navigation processor 108 subtracts the 
two digital images (acquired in step 206) on a pixel-by-pixel basis, thereby 
generating another difference image, which is referred to as a sample difference 

20 image. 

In step 210, navigation processor 108 correlates the reference difference 
image (generated in step 204) with the sample difference image (generated in 
step 208), and determines a magnitude and direction of movement based on the 
correlation. In step 212, navigation processor 108 generates movement 

25 information based on the correlation performed in step 210, and outputs the 

movement information to a host device via digital input/output circuitry 106. In 
step 214, the reference difference image (generated in step 204) is replaced by 
the sample difference image (generated in step 208), which then becomes the 
reference difference image for the next iteration of method 200. Another pair of 

30 temporally offset images is then acquired in step 206, and the method 200 is 



PATENT 
PDNO 10040348-1 



repeated from step 206. Any desired number of iterations of method 200 may be 
performed. 

The temporal differencing in method 200 reduces the fixed pattern 
sensitivity of the computations made by navigation processor 108. In one 
5 embodiment, four consecutive images are acquired at equal time intervals 

between each image. Differences between a first set of two of the images and a 
second set of two of the images are correlated to determine movement 
information. In another embodiment, the time interval between captured images 
is varied, to provide, for example, in a set of four consecutive images, a different 

10 time interval between the first and second images than the time interval between 
the third and the fourth images. 

Figure 3 is a flow diagram illustrating a method 300 for generating 
movement data with optical pointing device 100 using cross-correlation of row 
sums and column sums according to one embodiment of the present invention. 

15 In step 302, a reference image is acquired by photo array 1 14. The acquired 
image is converted into a digital image by analog to digital converter 112, and 
the reference digital image is output to navigation processor 108. In step 304, 
navigation processor 108 sums the pixel values in each row of the reference 
digital image, thereby generating a plurality of row sums, and also sums the 

20 pixel values in each column of the reference digital image, thereby generating a 
plurality of column sums. 

In step 306, a sample image is acquired by photo array 1 14. The 
acquired image is converted into a digital image by analog to digital converter 
112, and the sample digital image is output to navigation processor 108. In step 

25 308, navigation processor 108 sums the pixel values in each row of the sample 
digital image, thereby generating a plurality of row sums, and also sums the 
pixel values in each column of the sample digital image, thereby generating a 
plurality of column sums. 

In step 310, navigation processor 108 correlates the plurality of row sums 

30 of the reference digital image (acquired in step 302) with the plurality of rows 
sums of the sample digital image (acquired in step 306); correlates the plurality 
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of column sums of the reference digital image with the plurality of column sums 
of the sample digital image; and determines a magnitude and direction of 
movement based on the correlations. In step 312, navigation processor 108 
generates movement information based on the correlations performed in step 
5 310, and outputs the movement information to a host device via digital 

input/output circuitry 106. In step 314, the reference digital image (acquired in 
step 302) is replaced by the sample digital image (acquired in step 306), which 
then becomes the reference digital image for the next iteration of method 300. 
Another sample image is then acquired in step 306, and the method 300 is 
10 repeated from step 306. Any desired number of iterations of method 300 may be 
performed. 

By performing cross-correlations on row and column sums of pixel 
values, which are also referred to as "projections", rather than on individual 
pixel values, the sensitivity of the computations made by navigation processor 

15 108 to fixed pattern artifacts is reduced. The fixed pattern sensitivity is reduced 
because the projections inherently average the pixel values. 

Figure 4 is a flow diagram illustrating a method 400 for generating 
movement data with optical pointing device 100 using false correlation peak 
detection according to one embodiment of the present invention. In step 402, a 

20 reference image is acquired by photo array 114. The acquired image is 
converted into a digital image by analog to digital converter 112, and the 
reference digital image is output to navigation processor 108. In step 404, a 
sample image is acquired by photo array 1 14. The acquired image is converted 
into a digital image by analog to digital converter 1 12, and the sample digital 

25 image is output to navigation processor 108. 

In step 406, navigation processor 108 performs a cross-correlation of the 
pixel values of the reference digital image with the pixel values of the sample 
digital image, thereby generating at least one correlation peak. Fixed patterns in 
the images that are correlated result in false correlation peaks occurring at a 

30 location corresponding to a zero (0,0) displacement. These peaks are referred to 
as "false" correlation peaks because they indicate that no movement has 

10 
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occurred, when, in fact, movement may have occurred between the two images. 
In one embodiment, as described in further detail below, these false correlation 
peaks are ignored if there is evidence that motion is occurring. 

In step 408, navigation processor 108 determines whether the correlation 
5 performed in step 406 has produced a correlation peak at a location 

corresponding to zero displacement. If the correlation has not produced a 
correlation peak at a location corresponding to zero displacement, the method 
400 moves to step 416 (described below). If the correlation has produced a 
correlation peak at a location corresponding to zero displacement, the method 

10 400 moves to step 410. 

In step 410, navigation processor 108 determines whether the correlation 
performed in step 406 has produced a correlation peak at a location 
corresponding to a non-zero displacement. If the correlation has not produced a 
correlation peak at a location corresponding to a non-zero displacement, the 

15 method 400 moves to step 414 (described below). If the correlation has 
produced a correlation peak at a location corresponding to a non-zero 
displacement, the method 400 moves to step 412. 

In step 412, navigation processor 108 determines whether motion has 
occurred between capturing of the reference image (step 402) and capturing of 

20 the sample image (step 404). In one embodiment, navigation processor 108 
determines whether motion has occurred in step 412 by monitoring a single 
pixel, or a plurality of pixels, in the reference image and the sample image, and 
determining whether the single pixel (or plurality of pixels) has changed in value 
by a threshold amount, which would indicate that motion has occurred. In one 

25 form of the invention, navigation processor 108 determines whether motion has 
occurred in step 412 by determining whether a strong secondary peak (e.g., a 
peak with a magnitude greater than a given threshold) occurs at a location 
corresponding to a non-zero displacement, either for one correlation calculation, 
or for multiple correlation calculations. If navigation processor 108 determines 

30 in step 412 that motion has not occurred, the method 400 moves to step 414. If 
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navigation processor 108 determines in step 412 that motion has occurred, the 
method 400 moves to step 416. 

In step 414, navigation processor 108 determines that the correlation 
peak occurring at a location corresponding to zero displacement is not a false 
5 correlation peak, and that the displacement between the reference image and the 
sample image is zero. After step 414, the method 400 moves to step 418 
(described below). 

In step 416, navigation processor 108 determines that any correlation 
peak occurring at a location corresponding to zero displacement is a false 
10 correlation peak, and navigation processor 108 determines the displacement 

based on a correlation peak occurring at a location corresponding to a non-zero 
displacement. After step 416, the method 400 moves to step 418 (described 
below). 

In step 418, navigation processor 108 generates movement information 
15 based on the displacement determined in step 414, or based on the displacement 
determined in step 416, and outputs the movement information to a host device 
via digital input/output circuitry 106. 

In step 420, the reference digital image (acquired in step 402) is replaced 
by the sample digital image (acquired in step 404), which then becomes the 
20 reference digital image for the next iteration of method 400. Another sample 
image is then acquired in step 404, and the method 400 is repeated from step 
404. Any desired number of iterations of method 400 may be performed. 

ffl. DEFECTIVE PIXEL DETECTOR 

25 Figure 5 is a block diagram illustrating major components of an optical 

pointing device 500 with a defective pixel detector 511 according to one 
embodiment of the present invention. In the embodiment illustrated in Figure 5, 
optical pointing device 500 includes the same elements and is configured in the 
same manner as the optical pointing device 100 shown in Figure 1, with the 

30 exception that a defective pixel detector 51 1 is included in optical navigation 
sensor integrated circuit 502. 
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Like optical pointing device 100, analog to digital converter 1 12 in 
optical pointing device 500 generates digital images based on the analog signals 
provided by photo array 1 14. The digital images are output to defective pixel 
detector 511. In one embodiment, defective pixel detector 511 identifies bad or 
5 defective pixels in the received digital images, such as pixels that are not 
responding properly due to dust or other particle contamination, and outputs 
digital image data with only "good" (i.e., non-defective) pixels to navigation 
processor 108. The good digital values output by defective pixel detector 511 
are stored as frames within memory 111 of navigation processor 108. 

10 There are several techniques that may be used by defective pixel detector 

511 to identify defective pixels, including techniques described in co-pending 

application U.S. Patent Application Serial No. , attorney docket 

no. 10040077-1, filed March 8, 2004, and entitled APPARATUS FOR 
CONTROLLING THE POSITION OF A SCREEN POINTER THAT 

15 DETECTS DEFECTIVE PIXELS, and described below, as well as other 

techniques. In one embodiment, defective pixel detector 511 includes a memory 
526 for storing an adaptive pixel history 528 for each of the pixels in photo array 
1 14. In one form of the invention, the adaptive history 528 includes, for each 
pixel, the time since the last change in value of the pixel. In one embodiment, 

20 pixels that have not changed in value for a threshold period of time (defective 
pixel threshold) are identified by detector 51 1 as being defective, and are not 
used in the navigation computation by navigation processor 508, effectively 
removing the defective pixels from the correlation. 

In one embodiment, an appropriate value for the defective pixel threshold 

25 is determined by monitoring individual pixel value changes versus changes in 
the average value for the whole photo array 1 14, or changes in an average value 
for a pixel's local neighbors. In this embodiment, the defective pixel threshold is 
adaptive, and depends on the behavior of the aggregate array 1 14 or a subset of 
the array 1 14. 

30 Noise is typically an issue with digital image sensors. One form of the 

defective pixel detector 511 uses a method of identifying defective pixels that is 
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robust to noise. A noise-tolerant method according to one embodiment of the 
invention maintains an adaptive history for each pixel by recursively updating a 
"smooth" frame, S, based on each captured digital image (referred to as an input 
frame, /). A smooth frame according to one form of the invention is a frame that 
5 changes relatively slowly compared to the changes that occur in successive input 
frames. The smooth frame according to one embodiment represents an average 
of past frames. In another embodiment of the invention, rather than using a 
smooth frame, a number of past frames are stored, and an average value is 
calculated from the stored frames. In one embodiment, defective pixel detector 
10 511 updates the smooth frame based on each captured digital image (input 
frame) using the following Equation I: 
Equation I 

S = a*S+(7-a > >*/. 
Where: 

15 S = smooth frame; 

a — constant value; and 
/ = input frame. 

In one embodiment, the pixel values of the smooth frame are stored in 
memory 526 within defective pixel detector 51 1. For values of the constant, a, 

20 near 1 .0, the smooth frame changes slowly with each input frame, /, and 
therefore does not respond to small noise fluctuations. In one form of the 
invention, a value of 0.75 is used for the constant, a, in Equation I. In other 
embodiments, other values for the constant, a, are used. 

In one embodiment, the pixel history 528 includes a set of counters that 

25 keep track of how many consecutive frames that each pixel in an input frame, /, 
falls within a threshold value, T, of a corresponding pixel in the smooth frame, S. 
In one embodiment, if the intensity of any pixel in an input frame, /, is less than 
the threshold, T, in absolute value from a corresponding pixel in the smooth 
frame, S, for N consecutive frames, then defective pixel detector 511 identifies 

30 the pixel as being defective. In one form of the invention, if a pixel's change in 
value from the smooth frame, 5, exceeds the threshold, T, in any frame of the N 
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consecutive frames, the pixel is deemed by defective pixel detector 511 to be 
active (or "good"). In one embodiment, the variable N represents an integer that 
is greater than one. In one embodiment, a value of "10" is used for the variable 
N. In other embodiments, other values are used for the variable N. 
5 In one form of the invention, the digital images generated by analog to 

digital converter 112, such as digital image 530 in memory 526, include a set of 
active pixels 532A that are used for the navigation computation, and a set of 
spare pixels 532B that are not used for the navigation computation. In one 
embodiment, if defective pixel detector 511 detects that one of the active pixels 

10 532A in a digital image is defective, defective pixel detector 511 deactivates the 
defective pixel, and activates one of the spare pixels 532B. Defective pixel 
detector 511 then provides the set of active pixels 532A, including the newly 
activated spare pixel, but not including the deactivated defective pixel, to 
navigation processor 108 for correlation. One embodiment of a method for 

15 generating movement data based on a set of active pixels 532A is described 
below with reference to Figure 6. 

Figure 6 is a flow diagram illustrating a method 600 for generating 
movement data with the optical pointing device 500 shown in Figure 5 based on 
a set of active pixels 532A according to one embodiment of the present 

20 invention. In step 602, a reference image is acquired by photo array 1 14. The 
acquired image is converted into a digital image by analog to digital converter 
1 12, and the reference digital image is output to defective pixel detector 511. In 
step 604, a sample image is acquired by photo array 114. The acquired image is 
converted into a digital image by analog to digital converter 112, and the sample 

25 digital image is output to defective pixel detector 511. The reference digital 

image and the sample digital image each include a set of active pixels 532A and 
a set of spare pixels 532B. 

In step 606, defective pixel detector 511 identifies and deactivates 
defective pixels in the reference digital image (acquired in step 602) and the 

30 sample digital image (acquired in step 604). In step 608, defective pixel detector 
511 activates spare pixels 532B in the reference digital image and the sample 

15 
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digital image based on the defective pixels identified in step 606. In one 
embodiment, defective pixel detector 511 activates one spare pixel 532B for 
each defective pixel that is deactivated. In step 610, defective pixel detector 511 
outputs the set of active pixels 532A for the reference digital image and the 
5 sample digital image to navigation processor 108. In one embodiment, the set of 
active pixels provided to navigation processor 108 includes any newly activated 
spare pixels 532B (i.e., any pixels activated in step 608), but does not include 
any deactivated defective pixels (i.e., any pixels deactivated in step 606). Thus, 
in one form of the invention, only non-defective pixels are provided to 

10 navigation processor 108 for correlation. 

In step 612, navigation processor 108 correlates the received set of active 
pixels 532A for the reference digital image (acquired in step 602) with the set of 
active pixels 532A for the sample digital image (acquired in step 604), and 
determines a magnitude and direction of movement based on the correlation. In 

15 step 614, navigation processor 108 generates movement information based on 
the correlation performed in step 612, and outputs the movement information to 
a host device via digital input/output circuitry 106. In step 616, the reference 
digital image (acquired in step 602) is replaced by the sample digital image 
(acquired in step 604), which then becomes the reference digital image for the 

20 next iteration of method 600. Another sample image is then acquired in step 
604, and the method 600 is repeated from step 604. Any desired number of 
iterations of method 600 may be performed. 

In one embodiment, the digital images generated by analog to digital 
converter 112, such as digital image 534 in memory 526, include an array of 

25 pixels 536A. In one form of the invention, rather than activating spare pixels 
532B as defective pixels are identified as described above, defective pixel 
detector 511 identifies a sub-array of non-defective pixels 536B, which are used 
in the navigation computation. In one embodiment, the pixels 536A outside of 
the sub-array 536B are not used in the navigation computation. One 

30 embodiment of a method for generating movement data based on a sub-array of 
pixels 536B is described below with reference to Figure 7. 
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Figure 7 is a flow diagram illustrating a method 700 for generating 
movement data with the optical pointing device 500 shown in Figure 5 based on 
a sub-array of pixels 536B according to one embodiment of the present 
invention. In step 702, a reference image is acquired by photo array 1 14. The 
5 acquired image is converted into a digital image by analog to digital converter 
112, and the reference digital image is output to defective pixel detector 511. In 
step 704, a sample image is acquired by photo array 114. The acquired image is 
converted into a digital image by analog to digital converter 112, and the sample 
digital image is output to defective pixel detector 511. 
10 In step 706, defective pixel detector 511 identifies and flags defective 

pixel locations in the reference digital image (acquired in step 702) and the 
sample digital image (acquired in step 704). In step 708, defective pixel detector 
511 identifies a sub-array of good pixel locations 536B in the digital images. In 
one form of the invention, the sub-array 536B contains only good (e.g., non- 
15 defective) pixels, and does not include any defective pixels. In one embodiment, 
the sub-array of good pixel locations 536B comprises a subset of the entire array 
of pixels 536A contained in the digital images, such as a 22 by 22 block of 
pixels within a 40 by 40 pixel digital image, for example. Defective pixel 
detector 511 provides the sub-arrays of good pixels 536B from the reference 
20 digital image and the sample digital image to navigation processor 108. 

In step 710, navigation processor 108 correlates the sub-array of good 
pixels 536B from the reference digital image with the sub-array of good pixels 
536B from the sample digital image, and determines a magnitude and direction 
of movement based on the correlation. In step 712, navigation processor 108 
25 generates movement information based on the correlation performed in step 710, 
and outputs the movement information to a host device via digital input/output 
circuitry 106. In step 714, the reference digital image (acquired in step 702) is 
replaced by the sample digital image (acquired in step 704), which then becomes 
the reference digital image for the next iteration of method 700. Another sample 
30 image is then acquired in step 704, and the method 700 is repeated from step 
704. Any desired number of iterations of method 7000 may be performed. 
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In one embodiment, defective pixel detector 511 is implemented with 
digital logic and circuitry. It will be understood by a person of ordinary skill in 
the art that functions performed by optical pointing devices 100 and 500, 
including defective pixel detector 511, may be implemented in hardware, 
software, firmware, or any combination thereof. The implementation may be via 
a microprocessor, programmable logic device, or state machine. Components of 
the present invention may reside in software on one or more computer-readable 
mediums. The term computer-readable medium as used herein is defined to 
include any kind of memory, volatile or non-volatile, such as floppy disks, hard 
disks, CD-ROMs, flash memory, read-only memory (ROM), and random access 
memory. 

Although specific embodiments have been illustrated and described 
herein for purposes of description of the preferred embodiment, it will be 
appreciated by those of ordinary skill in the art that a wide variety of alternate 
and/or equivalent implementations may be substituted for the specific 
embodiments shown and described without departing from the scope of the 
present invention. Those with skill in the mechanical, electro-mechanical, 
electrical, and computer arts will readily appreciate that the present invention 
may be implemented in a very wide variety of embodiments. This application is 
intended to cover any adaptations or variations of the preferred embodiments 
discussed herein. Therefore, it is manifestly intended that this invention be 
limited only by the claims and the equivalents thereof. 
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